According to reference magnetism, there are facts independent from our psychology and conventions which make certain things more eligible (or magnetic) to be the targets of our thought and talk, constraining content. In this paper, we clarify how these magnets would need to work in order to play their proposed metasemantic roles, and raise a number of significant challenges for them.